A user simulator based on voiceXML for evaluation of spoken dialog systems
نویسندگان
چکیده
This paper describes a user simulator based on analysis of VoiceXML description. A user simulator is a method to evaluate a spoken dialog system without the use of human evaluators. The new feature of our simulator is that it uses a VoiceXML description that describes the dialog system’s behavior. By using the VoiceXML description, the proposed simulator can be used for any dialog system that works with VoiceXML. We constructed a prototype of the user simulator and carried out an evaluation experiment. The experimental result showed that the dialog between the simulator and the dialog system had similar properties to that between human subjects and the dialog system.
منابع مشابه
Development and evaluation of a spoken dialog system to access a newspaper web site
This paper presents a system that provides access to a newspaper web site. The system is based on an interaction model, that uses browse and search strategies, and on an information model, which is made up of a tree and indexes. A frame-based approach is used to control the dialog flow. VoiceXML is used as a language to describe dialog turns. The systems works for Spanish language. To measure t...
متن کامل"Help Me, I Need More User Tests!" User Simulations as Supportive Tool in the Development Process of Spoken Dialogue Systems
In this paper we present our experiences in developing a spoken dialogue system supported by tests with a user simulation. Since the code of dialogue systems with modest complexity can easily get unclear, it is almost impossible to deliver error-free systems without user tests in the development process. We show how we included our user simulation environment SpeechEval in the development proce...
متن کاملDevelopment of slovak GALAXY/voiceXML based spoken language dialogue system to retrieve information from the internet
In this paper we describe the research and development of the first Slovak spoken language dialogue system. The dialogue system is based on the DARPA Communicator architecture. The proposed system consists of the Galaxy hub and telephony, automatic speech recognition, text-to-speech, backend, transport and VoiceXML dialogue management modules. The SLDS enables multi-user interaction in the Slov...
متن کاملEVALITA 2009: Loquendo Spoken Dialog System
This report describes the implementation of Loquendo‟s spoken dialog application for the Evalita 2009 Spoken Dialog System (SDS) Evaluation task. The application was designed in VoiceXML and runs on the Loquendo VoxNauta platform. The dialogue strategy is „mixed-initiative‟, with flexible recognition grammars that were designed to be modular and easy to use in different dialogue application con...
متن کاملUser Simulation as Testing for Spoken Dialog Systems
We propose to use user simulation for testing during the development of a sophisticated dialog system. While the limited behaviors of the state-of-the-art user simulation may not cover important aspects in the dialog system testing, our proposed approach extends the functionality of the simulation so that it can be used at least for the early stage testing before the system reaches stable perfo...
متن کامل